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performance,  m the  aircraft.  It  was  also  found  that  the  pilot  students  continued  to  improve  throughout  all  missions 
in  the  AR  Phase. 
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KC-1 35  director  lights 
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Refueler  trainer,  Phase  1 Model  . . . . 


Page 

6 

8 

9 


AIR  KM  HI  I IN(J  UIKI  CIOK  UtillTS  IK  AIM  K 
AN  Al  YSIS  AND  I VALUATION  Ol  TRAINING  I I I I (TIVI  N1  SS 


I.  IN  IRODlin  ION 

An  inflight  [dueling  capability  is  provided  on  various  aircraft  to  extend  their  operational  range  01 
etuluiance.  In  outer  to  assist  the  leceiver  pilot  in  maintaining  a correct  position  during  air  refueling,  receiver 
director  lights  are  provided  as  a primary  visual  refeicnce  on  the  underside  ol  the  fuselage  ol  the  tankei  1 Ins 
study  is  the  fust  ol  two  validation  studies  to  he  conducted  on  the  Air  Keluehng  Diiectoi  I ights  1 lamer  l. 
Hie  second  study  is  to  he  conducted  operationally  on  the  f-JA  by  the  ‘Xiotli  Airborne  Warning  and 
(’ontiol  Training  Squadion,  l inker  Al  H.  Oklahoma.  Die  time  sequence  lunges  on  a similar  trainer  being 
built  and  shipped  to  Tinker  Al  H.  Woik  on  the  duplicate  tiainei  began  dining  April  l‘>7S  with  a projected 
delivery  date  tu  late  June  I *>7S. 

Problem  Statement  and  Study  Rationale 

According  to  the  14  Phase  Manual  (see  Appendix  Al,  the  duector  lights  on  the  tanker  aie  to  be  used 
as  the  pitman  leicicnce  dining  ,ui  letuelmg.  On  the  kl'-US  tankei,  the  lights  are  located  between  the  nose 
landing  gear  and  the  main  lauding  gear  and  consist  ol  two  tows  thelelt  row  lot  elevation  corrections  and 
the  right  row  lot  lore  and  alt  corrections  I jgme  1 depicts  the  aiiangcmcnt  and  colors  ot  the  direct  oi  lights. 
Note  the  double  bars  on  the  center  ot  each  panel,  commonly  referred  to  as  Captains  Bars.  The  lights  ate 
controlled  niainialK  hi  the  boom  opeiator  in  the  tanker  prior  to  contact  with  the  receiver  After  contact, 
the  boom  posrtioti  aulomalicallv  illuminates  the  lights,  diiectmg  the  receiver  to  the  center  ot  the  boom 
envelope.  Mils  position  is  attained  when  both  sets  ol  Captains  Bats  ate  illuminated. 

It  should  be  noted  that  the  lights  do  not  give  true  hoii/ontal  and  vertical  information.  Angulai  boom 
movements  cause  changes  m the  up-and-down  low  ol  lights,  and  telescoping  movements  ot  the  boom  cause 
changes  in  the  lore  and  alt  lights  (1.0  I 1C  I SI.  Since  the  axis  ot  the  duector  lights  is  inclined  at  a 
JOdegree  angle  to  the  lauket  fuselage,  both  tows  ot  lights  interact  when  the  icceivei  makes  a tine 
hoiiAittt.il  oi  veitical  movement,  l or  example,  it  a true  vertical  (down!  movement  was  made,  the  boom 
would  extend  and  uiciease  its  angle  with  the  tankei . giving  a combined  light  indication  to  "go  up  and  at t ." 
riietefoie,  pilots  ericoiinteiing  the  director  lights  ss  stem  must  understand  the  interaction  of  the  lights  and 
the  necessaiy  control  inputs  in  ordet  to  use  the  sy  stem  advantageously  in  maintaining  piopei  position. 

There  is  an  inherent  problem  in  the  diiectoi  lights  system  when  a tightei  aircraft  is-utt  tetueling. 
because  the  lights  weie  ouguially  designed  loi  use  by  bombers.  Any  pilot  must  fust  determine  what  the 
lights  aie  tluect mg  Inin  to  do.  and  then  he  must  make  the  appropriate  response.  The  difficulty  with  fighters 
ts  that  the  response  tor  an  up-down  correction  (left  row  of  lights)  is  primarily  made  with  the  control  stick 
which  is  operated  with  the  receiver  pilot's  right  hand.  The  same  eross-relerence  is  true  toi  the  throttle  (let t 
hand)  and  the  tore-aft  lights  (right  row).  When  a pilot  in  the  cockpit  of  an  T4C  refuels,  he  tuuls  the 
teceiver  director  lights  difficult  to  see.  They  are  very  far  forward  on  the  tanker,  and  with  sunlight  hitting 
them,  they  mav  be  obscured  fiom  view.  The  pilot's  seat  position  and  visual  angle  make  a significant 
difference  in  the  utility  of  the  lights.  Lor  example,  during  this  study  several  pilots  mentioned  the  tact  that 
looking  under  the  canopy  bow  restiicted  their  field  of  view  to  the  belly  of  the  tanker. 

Study  Objectives 

The  purposes  of  this  study  were  as  follows 

1.  Determine  whether  the  pilot  students  could  meet  the  eritevion-refeieneed  objectives  (CROs) 
developed  specifically  for  this  study  by  the  444-lth  Operations  Squadron  (Opeiational  Training 
IX’velopmenl)  at  1 like  AI  R using  the  Aii  Refueling  Director  l ights  Viainet  (see  Appendix  B). 

2.  I valuate  the  relative  contribution  of  director  lights  training  to  pilot  pciformance. 


' 

t 


3.  Analyze  the  configuration  of  the  trainer  as  a prototype  for  subsequent  models. 

Background 

The  impetus  for  the  development  of  this  trainer  was  an  air  refueling  accident  in  August  1976  at  Luke 
AFB  and  a Training  Aid  Request  dated  13  October  1976  sent  to  the  Tactical  Air  Command/Instructional 
Systems  Division  (TAC/DOXS)  requesting  a trainer  be  built.  The  trainer  was  to  be  based  on  a Director 
Lights  Trainer  at  the  93rd  Bomb  Wing,  Castle  AFB,  California  (see  Figure  2).  TAC/DOXS  in  turn  directed 
that  it  be  processed  by  the  Training  Aids  Group  at  Luke  AFB.  In  addition,  the  request  specified  an  analysis 
be  conducted  to  determine  the  learning  objectives  for  this  device.  This  analysis  was  to  answer  the  following 
questions: 

1.  Can  the  training  be  accomplished  with  a more  economical  medium  than  this  device? 

2.  Is  the  training  equality  currently  available  with  other  media  (i.e.  flight  simulator)? 

3.  What  functions  must  this  device  teach? 

Because  of  the  training  aspects  involved  in  answering  these  questions.  Training  Aids  worked  closely 
with  the  F4  Operations  Training  Development  (OTD)  team  to  validate  the  device. 

The  first  model  of  the  trainer  (Phase  1 model)  was  developed  with  two  small  models  of  the  F4 
aircraft  attached  to  the  end  of  booms  which  were  moved  in  response  to  the  director  lights  (see  Figure  3). 
These  aircraft  models  had  hand  grips  underneath  them  for  the  pilot  students  to  move  the  aircraft  in 
response  to  the  director  lights.  An  OTD  team  from  4444th  Operations  Squadron  tested  the  trainer  at  the 
426th  Tactical  Fighter  Training  Squadron  (TFTS)  at  Luke  AFB  with  instructor  pilots  (IPs),  and  the  results 
were  negative.  The  psychomotor  responses  required  by  the  pilots  were  not  realistic  and  probably  would  not 
result  in  transfer  of  learning  to  the  aircraft.  The  IPs  indicated  that  the  trainer,  in  that  configuration,  would 
cause  negative  training  effects  for  the  pilot  students.  Therefore,  Training  Aids  redesigned  the  trainer  into 
the  hardware  configuration  used  for  this  study.  In  March  1978,  the  4444th  Operations  Squadron  requested 
assistance  in  an  evaluation  of  this  trainer  from  the  Tactical  Research  Branch  of  the  Air  Force  Human 
Resources  Laboratory/Flying  Training  Division  (AFHRL/FT). 

II.  METHOD 

The  research  design,  including  objectives  and  approach,  was  developed  specifically  as  a candidate 
training  program  incorporating  the  functions  the  device  would  teach. 

Preliminary  Evaluation 

A preliminary  evaluation  of  the  Director  Lights  Trainer  was  accomplished  utilizing  expert  opinions  of 
several  IPs  from  the  3 1 1 th  and  426th  TFTS.  This  preliminary  evaluation  was  to  insure  that  the  hardware 
configuration  was  adequate  to  meet  the  instructional  objectives.  The  responses  from  the  IPs  indicated  that 
the  trainer  design  was  functionally  correct  and  would  not  produce  negative  training  effects.  Therefore,  it 
was  considered  appropriate  to  proceed  with  the  evaluation  study. 

Participants 

A class  of  21  pilot  students  entering  the  air  refueling  phase  of  F4  training  with  the  311th  TFTS 
participated  in  this  study.  There  were  1 1 pilots  selected  for  the  Experimental  Group  and  10  pilots  for  the 
Control  Group.  The  two  groups  were  matched  as  evenly  as  possible  based  on  performance  ratings  by 
squadron  IPs  and  the  students  progress  to  date. 

Instructors 

All  instruction  on  the  Director  Lights  Trainer  was  given  by  one  IP  from  the  4444th  Operations 
Squadron.  Instruction  in  the  aircraft  was  given  by  the  regular  IPs  from  the  31 1th  TFTS. 
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Apparatus 

The  P-4C  airerall  anil  the  An  Refueling  Director  1 igltls  Trainer  were  tsed  in  this  study.  Hie  tiainei 
was  a tabletop  model  and  was  located  in  the  58th  Tactical  Training  Squadron  l earning  Center  wlieie  n was 
placed  in  one  of  the  learning  carrels.  The  following  description  of  the  trainer  briefly  delineates  those 
capabilities  used  in  this  experiment  (see  figure  4). 


Figure  4.  Air  refueling  director  lights  trainer.  Phase  II  Model. 


Stick  and  throttle  controls  were  mounted  side  by  side  at  the  front  of  the  trainer  for  both  the  IP  and 
the  student  positions  (see  f igure  5).  The  director  lights  were  mounted  overhead  at  both  positions,  at  a 
l>0-degrec  angle  to  the  back  of  the  trainer  and  parallel  to  the  base  of  the  controls  (see  figure  hf  The 
working  level  on  which  the  controls  were  mounted  was  800  millimeters  from  the  lloor.  Two  straight  backed 
chairs,  which  had  a seal  lieight  of  425  millimeters,  were  used  for  this  study  but  were  not  standard  equipment 
lor  the  trainer.  The  lights  replicated  those  found  on  the  KC-135  tanker  (see  figure  I). 

On  the  front  panel  of  the  trainer,  a breakaway  button  permitted  the  IP  to  Hash  all  of  the  lights  to 
indicate  “Breakaway.”  Also,  two  switches  were  on  the  front  panel,  one  for  normal  mode  and  one  lot  test 
mode  (see  figure  7).  The  normal  mode  allowed  the  IP  to  make  control  inputs  which  moved  both  sets  of 
director  lights.  The  student  could  then  make  control  inputs  which  corrected  the  lights  to  a neutral  position. 
When  an  IP  used  test  mode,  he  changed  the  second  switch  from  NORM  to  AUTO.  This  introduced 
automatic  cycling  into  the  lights.  A rheostat  in  the  back  of  the  trainer  could  be  used  to  adjust  the  rate  from 
slow  to  fast:  slow  being  40  seconds  for  a complete  cycle  and  last  being  10  seconds  for  a complete  cycle 
(outer  limit  light  to  outer  limit  light).  The  rate  used  in  this  study  was  10  seconds  pet  cycle  (see  Piguie  8). 
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V panel  i'll  (III-  IP  suit-  ol  llu-  liainei  li.nl  tom  switches  (see  liguie '»).  Out-  was  I'm  |m>wci  ( white  lights 
mil.  another  was  I'm  contact  made  (gieen  Captains  H.ns  mi)  ami  the  tliinl  ami  tonitli  switches  to  conliol 
the  I me  ami  all  lights  ami  the  up  and  down  lights  (nil  mitei  limit  lights  oil)  to  simulate  manual  boom 
o|H‘iatm  signalling  limn  pie  -contact  lo  iOiil.nl  posit  ton. 
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/ i.giirc  l>  Side  panel. 
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A maim  ohieclive  ol  (lie  appioaeli  was  dial  die  study  be  peiloinied  within  die  context  ol  typical  \u 
I one  (laming  opeialions.  Ibis  lequiiemeul  was  die  deleinuning  lacloi  in  the  studs  methodology  In 
evaluating  the  effectiveness  of  anx  (raining  device,  (lie  most  impoiianl  expeiimeni.il  design  consideiation  is 
dial  ol  iiauslei  of  (taming (I  ddow-es.  Il,77).  The  depemlenl  vaiiable  used  in  ibis  study  was  peiloimamv  in 
die  .me i .tit  dining  an  refueling.  ami  (lie  only  independent  vaiiable  was  diicctm  lights  li. lining  I o nuke  lull 
use  ol  the  liaiiuug  effectiveness  of  a device,  d nuisl  be  compatible  within  die  context  ol  its  total  turning 
piogiam  (Cato,  l‘*77V  I'lie  iioniial  syllabus  was  vailed  slightly  lot  die  expeiimenl.il  gioup  lo  allow  a 1 bom 
block  ol  turning  on  die  An  Refueling  Duecloi  I iglils  liainei.  A 70  nimiile  bnelmg  was  given  each  slmleul 
m the  I xpeiimeiil.il  (lioup  on  the  CROs  loi  (Ins  block  of  insltuclion,  die  boom  limits,  and  the  luuclion 
and  puipose  of  die  duecloi  lights.  I'lie  next  70  minute  block  ol  nisi  i net  ion  was  loi  oneiilalioii  and  piaclice 
on  (lie  liainei  The  Iasi  70  uniinCe  block  ol  lime  was  divided  into  S nimiile  limed  dials  I lie  pilots  xxeie 
tested  (o  see  whelhei  (hex  could  meet  (lie  t'ROs,  and  lliose  dial  could  nol  weie  given  anolliei  dial  \llei 
the  ti.uumg  peuod  loi  (lie  I xpemueiilal  tiioup.  both  gioups  llew  six  an  leluelmg  missions  m die  an c ■ at t 
■i  It  ) loin  weie  das  missions  and  two  weie  mglii  (see  Appendix  C) 


II 


Performance  Measurement 


Within  the  context  of  this  study,  performance  measures  were  employed  not  only  to  assess  student 
progress  but  also  to  evaluate  the  effectiveness  of  the  device.  The  essential  consideration  was  whether  the 
device  aided  the  pilots  in  making  correct  control  inputs  as  required  by  the  director  lights.  For  any 
performance  measurement  system  to  be  useful,  it  must  be  both  diagnostic  and  prescriptive.  The  measures 
available  at  present  do  not  necessarily  possess  these  characteristics.  Furthermore,  many  measures  that 
describe  the  student  behaviors  do  so  in  a rather  general  manner. 

The  „ystem  developed  for  this  study  had  some  specific  characteristics  that  were  both  descriptive  and 
prescriptive.  The  system  (I)  measured  pilot  behaviors  (control  inputs),  (2)  Was  three-dimensional, 
accounting  for  not  only  magnitude  and  direction,  but  also  timing,  (3)  Described  these  behaviors  in  a binary 
system  (correct-incorrect),  and  (4)  Was  easy  to  use  and  understand  by  both  IP  and  student. 

During  the  timed  trials,  grades  were  recorded  by  the  IP  on  a special  grade  slip  developed  specifically 
for  this  study  (see  Figure  10).  The  same  grading  procedures  were  used  by  the  IPs  during  each  air  refueling 
mission  in  the  aircraft  for  both  the  Control  and  the  Experimental  Groups.  The  normal  syllabus  grades  were 
also  recorded  for  each  air  refueling  mission  in  the  aircraft.  Only  some  of  the  normal  air  refueling  grades 
were  considered  to  be  adequate  measures  of  the  dependent  variable;  therefore,  this  study  considered  only 
the  grades  given  for  mission  elements  4 through  8 on  the  normal  grade  sheet  (see  Figure  1 1). 


Instructions:  A grade  should  be  recorded  for  each  trial  by  placing 
a checkmark  (vO  in  the  appropriate  blocks.  A trial  begins  at  pre- 
contact position  for  any  attempt  at  air  refueling: 


TRIAL 

NO. 

CONTROL  INPUTS 

REMARKS : 

DIRECTION 

MAGNITUDE 

TIMING 

CORRECT 

INCORRECT 

TOO 

MUCH 

NOT 

ENOUGH 

Figure  10.  Excerpt  of  special  grade  slip. 


Questionnaire  Data 

The  Experimental  Group  was  queried  about  the  training  objectives  and  hardware  configuration  of  the 
trainer  alter  tire  l*hour  block  ol  instruction  and  again  after  all  air  refueling  missions  were  flown  in  the 
aircraft.  The  Control  Group  was  asked  the  same  questions  after  they  received  instruction  on  the  trainer, 
which  was  given  following  all  aircraft  missions.  All  pilot  students  were  asked  questions  about  their  use  of 
the  lights  and  their  air  refueling  techniques  (e.g.,  changing  scat  position  and  looking  over  or  under  canopy 
bow)  alter  mission  No.  4 (last  day  air  refueling)  and  mission  No.  6 (last  night  air  refueling).  For  each 
mission  the  IPs  completed  a questionnaire  concerning  the  amount  of  commentary  they  gave  the  students. 
They  were  also  queried  about  the  difficulty  students  had  with  stick  and  throttle  corrections. 

Analysis 

Using  the  Univac  Stat-Pack  (1073),  a chi  square  test  tor  independence  was  performed  on  all  grades 
previous  to  air  refueling  for  each  pilot  student,  to  verify  that  the  groups  were  equally  matched  before 
starting  the  air  refueling  phase  of  training.  In  determining  the  effectiveness  of  transfer  of  training,  the  usual 
hypothesis  is  that  the  experimentally  trained  group  should  exhibit  a higher  “initial”  skill  level  when  the 
aircraft  phase  ot  training  is  begun  (Pohlmann  & Reed,  1078).  This  is  a particularly  reasonable  assumption 
when  the  experimental  training  is  blocked  prior  to  aircraft  training  rather  than  interspersed  with  the 
aircraft  training.  The  chi  square  test  was  employed  to  test  for  this  effect.  The  data  collected  from  the 
special  grade  sheets  for  each  air  refueling  mission  as  well  as  the  data  from  the  normal  grade  slips  were 
analyzed  as  to  the  number  of  correct  and  incorrect  control  input  responses  made  by  each  student.  Another 
analysis  using  chi  square  was  performed  to  determine  whether  learning  occurred  in  the  aircraft.  The  student 
grades  on  all  six  rides  in  the  air  refueling  (AR)  phase  were  analyzed. 

III.  RKSULTS 

Group  Equality 

The  groups  were  verified  as  being  equal  before  the  AR  phase  began.  The  frequency  distributions  of  all 
previous  scores  are  reflected  in  Table  1.  Using  a chi  square  lest,  this  study  could  find  no  significant 
difference  between  the  scores  recorded  for  the  two  groups  of  students  prior  to  the  training  on  the  Director 
Lights  Trainer.  Thus,  it  was  assumed  that  the  groups  were  properly  matched. 


Tabic  I.  Frequency  Distribution 


Experimental  Group 
Grade  Frequency 


Control  Group 
Grade  Frequency 


Grades  Prior  to  AR  Phase 


Scores  Prior  to  AR  Phase 


Experimental  Group 


Grade  Score 


Control  Group 


Grade  Score 


3 
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Questionnaire  Data 

The  open-ended  questionnaires  were  naturally  not  amenable  to  quantitative  analysis  but  did  provide 
valuable  insights  into  attitudes  and  opinions  about  the  Director  Lights  Trainer.  Both  the  Experimental  and 
Control  Croups  responded  that  the  Director  Lights  Trainer  did  assist  them  in  understanding  the  function  of 
the  lights  and  making  the  correct  control  inputs  (81%).  The  Experimental  Group  responded  unanimously 
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I l. 


that  no  negative  training  had  to  be  overcome  in  the  aircraft  as  a result  of  the  trainer.  According  to  the  IP 
questionnaires,  the  Control  Group  needed  more  IP  commentary  to  make  and  maintain  contact  with  the 
tanker  and  also  had  more  difficulty  with  strck  and  throttle  corrections  than  did  the  Experimental  Group. 


Aircraft  l>ata 


On  AR-I  (air  refueling  mission  No.  I),  the  Control  Group  made  more  control  input  errors  than  did 
the  IXperimental  Group  (see  Table  2).  The  Control  Group  made  more  incorrect  responses  than  they  made 
correct  responses.  The  IXperimental  Group  made  twice  as  many  correct  responses  as  incorrect  responses. 
Using  a chi  square  test,  these  results  were  significant  at  the  .Ob  level  on  the  first  ride  in  the  aircraft  using  the 
special  grade  sheets.  Using  the  regular  grades  given  to  the  pilot  students  under  the  normal  syllabus,  the 
IXperimental  Group  performed  significantly  better  than  did  the  Control  Group  for  AR-I  (p  < .01).  This 
seems  to  indicate  that  the  Air  Refueling  Director  Lights  Trainer  did,  in  fact,  contribute  to  the  performance 
of  the  IXperimental  Group  in  the  aircraft.  Table  3 depicts  the  frequency  distribution  of  the  normal  grades 
given  to  the  pilots  throughout  the  Air  Refueling  Phase. 

To  test  for  learning  during  air  refueling  missions  in  the  aircraft,  the  chi  square  test  was  again  utilized. 
I'he  results  of  these  analyses  showed  that  the  IXperimental  Group  had  an  increase  in  grades  between  AR-1 
and  AR-b  which  was  significant  at  the  .03  level.  The  Control  Group  showed  an  increase  in  grades  between 
AR-I  and  AR-b  which  was  significant  at  the  .01  level.  This  increase  itt  grade  level  can  he  assumed  to  have 
occurred  because  of  learning  in  the  aircraft. 


Table  2.  Control  Input  Responses  During  Air  Refueling 


Mission 

Experimental  Group 

Control  Group 

Correct 

% 

incorrect 

% 

Correct 

% 

Incorrect 

% 

AR-I 

23 

70 

10 

30 

14 

47 

ib 

53 

AR-2 

■>  1 

73 

8 

21 

2b 

70 

7 

27 

AR-3 

28 

85 

5 

15 

24 

so 

b 

20 

AR-) 

20 

88 

4 

12 

25 

83 

5 

17 

AR-5 

20 

88 

4 

12 

27 

00 

3 

10 

AR-b 

30 

‘>1 

3 

0 

27 

‘>0 

3 

10 

! 1 
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Tiihlc  x Frequency  Distribution  of 
Nonnol  Syllabus  tirades 


Items  4 8 (See  Figure  1 1 I 


Experimental  Group 

Control  Group 

Million 

Score 

Fr€qu0ncy 

Score 

Frequency 

AR1 

0 

> 

0 

h 

i 

12 

i 

2b 

•> 

41 

> 

33 

5 

0 

4 

0 

4 

0 

AR-2 

0 

0 

0 

0 

1 

5 

1 

8 

33 

34 

3 

23 

3 

21 

4 

0 

4 

0 

AR-3 

0 

0 

0 

> 

1 

1 

3 

> 

30 

20 

3 

23 

3 

21 

4 

0 

4 

0 

AR4 

0 

0 

0 

0 

1 

5 

1 

21 

38 

3 

25 

3 

to 

4 

4 

4 

0 

AR-5 

0 

0 

0 

0 

1 

1 

5 

*> 

2b 

25 

3 

27 

3 

20 

4 

0 

4 

0 

AR-b 

0 

1 

0 

0 

l 

•> 

1 

0 

”> 

20 

1 

12 

3 

28 

3 

38 

4 

0 

4 

0 

IV.  DISCUSSION 

The  research  performed  in  (his  study  addressed  the  three  questions  contained  in  the  request  for  the 
trainer: 

1 . Can  the  training  be  accomplished  with  a more  economical  medium  than  this  device? 

2.  Is  the  training  equality  currently  available  with  other  media  (i.e..  (light  simulator)? 

3.  What  functions  must  this  device  teach? 

The  fust  question  concerns  economy,  and  the  answer  is  that  the  cost  of  the  Air  Refueling  Director 
Lights  Trainer  is  minimal.  Briefings  or  a film,  such  as  the  one  shown  to  the  pilot  students  during  their  aii 
refueling  phase  briefing  (see  Appendix  D),  would  not  provide  training  in  the  required  psychoinotor 
responses. 

To  answer  the  second  question  requires  that  all  simulators  now  in  the  inventory  he  assessed.  Tactical 
Air  Command  does  not,  at  present,  have  a fighter  simulator  programmed  with  visual  detail  to  train  in  this 


area,  specifically  with  reference  to  the  director  lights.  However,  the  F-3A  simulator  at  Tinker  AFB  (Tactical 
Air  C ommand)  does  have  this  capability,  and  the  Strategic  Air  Command  is  scheduled  to  receive  a B-52  air 
refueling  part-task  trainer  in  late  1978  at  Castle  AFB(SAC  Plan  A/F37A-T77).  A study  was  also  conducted 
at  AFHRL/FT  (Air  Force  Systems  Command)  during  February  1978  using  the  Advanced  Simulator  for 
Pilot  Training  to  evaluate  the  visual  requirements  for  training  air  refueling  in  future  devices  (Woodruff, 
Longridge.  Irish,  & Jeffries,  1979). 

The  third  question  initiated  the  analysis  of  this  trainer.  The  device,  as  it  was  configured  for  the  study 
at  Luke  AFB,  was  not  designed  to  teach  pilot  students  to  air  refuel.  Its  only  purpose  was  to  train 
recognition  and  response  to  the  stimulus  of  the  director  lights  with  transfer  of  training  to  the  aircraft. 
Whether  it  accomplished  this  goal  was  a question  this  study  attempted  to  answer.  Based  on  the  results  ol 
this  study,  training  on  the  Air  Refueling  Director  Lights  Trainer  can  be  accomplished  in  the  l -hour  block  of 
time  allocated.  The  number  of  trials  made  by  each  student  on  the  trainer  appears  at  Table  4.  It  must  be 
restated  that  the  Control  Group  received  this  training  after  all  air  refueling  missions  in  the  aircraft  were 
flown  and  the  data  for  the  study  had  been  collected. 

Tabic  4.  Number  of  Trials  in  Director  Lights  Trainer 


Experimental  Group 

Trials  12  3 4 

Number  of 

Students  7301 

64%  of  the  students  accomplished  training  (met  CRO) 
in  one  trial.  91%  accomplished  training  in  two  trials. 

Control  Group 

Trials  12  3 4 

Number  of 

Students  2 7 10 

Only  209?  of  the  students  accomplished  training  in 
one  trial.  90%  accomplished  training  in  two  trials. 

Some  recommendations  for  the  trainer  were  suggested  by  the  pilot  students  and  dealt  with  the 
position  and  feel  of  the  stick  and  throttle.  They  indicated  the  throttle  should  be  moved,  perhaps  lower  or 
on  the  side  since  the  controls  were  quite  close  together.  They  also  suggested  that  the  centering  spring  be 
removed  from  the  throttle  since  the  throttle  in  the  aircraft  does  not  return  to  neutral.  Several  students  also 
indicated  that  the  feel  of  the  controls  was  different  from  those  in  the  aircraft. 

The  “automatic"  feature  of  the  trainer  continued  to  complete  a cycle  after  it  was  interrupted  by  a 
throttle  or  stick  input  by  the  IP.  This  resulted  in  an  unsatisfactory  training  situation  because  students 
become  aware  very  quickly  that  they  could  anticipate  the  appropriate  response.  Several  times,  the  IP 
requested  the  students  to  allow  the  lights  to  go  out  of  phase  so  that  the  students  were  then  making  control 
responses  in  different  directions. 

The  trainer  was  built  1075  millimeters  wide,  but  the  seating  position  and  controls  location  caused 
both  the  IP  and  the  student  to  need  a 575-millime‘er  wide  space  each  in  which  to  work.  The  trainer  should 
be  reconfigured  to  allow  at  least  a 1500-millimeter  working  area  if  the  student  and  IP  are  to  be  seated  side 
by  side. 

The  original  nomenclature  of  the  device  was  Refueler  Trainer,  and  the  IP  who  instructed  on  the 
trainer  had  to  explain  to  each  student  that  it  was  not  designed  to  teach  air  refueling.  A recommendation  of 
this  study  is  that  the  name  be  changed  to  Air  Refueling  Director  Lights  Trainer. 

The  pilots  in  both  groups  were  queried  as  to  whether  a sound-slide  presentation  would  be  beneficial 
as  an  adjunct  to  the  Director  Lights  Trainer,  and  80%  responded  affirmatively. 
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Another  recommendation  deals  with  the  director  lights  on  the  tanker  itself.  The  configuration  of  the 
lights  on  the  KC-135  tanker  is  different  from  that  of  the  KC-97;  however,  neither  system  allows  for  any 
flexibility  as  to  type  of  receiver.  One  of  the  considerations  brought  out  in  this  study  was  the  cross-reference 
required  for  eye-hand  coordination  in  fighter-type  aircraft.  Also,  the  location  of  the  lights  on  the  tanker 
fuselage  was  not  consistent  with  ficld-of-view  considerations  for  some  receivers.  With  the  advent  of  future 
tanker  and  receiver  aircraft,  designers  should  take  a closer  look  at  the  compatibility  of  these  systems. 
Suggested  alternatives  to  the  current  configuration  might  be  (a)  a flexible  “computer  scoreboard”  type  of 
system  that  would  be  adaptable  to  the  specific  receiver  requirements,  (b)  relocation  of  die  lights,  or  (c) 
multiple  locations  for  various  receivers. 


V.  PERSPECTIVE 

The  study  was  performed  to  meet  three  objectives  dealing  with  the  role  and  effects  of  simulation 
when  applied  to  training  the  acquisition  of  air  refueling  director  lights  response  skills  in  an  initial  air 
refueling  training  environment.  Further,  the  study  was  conducted  in  a manner  that  was  realistic  from  an 
operational  viewpoint. 

In  evaluating  the  usefulness  of  any  device,  it  cannot  be  separated  from  the  training  program.  The 
cognitive  pretraining  given  in  this  study,  along  with  the  perceptual-motor  skills  practiced,  served  to  establish 
a perceptual  framework  prior  to  entering  the  aircraft  for  the  first  air  refueling  mission.  This  training  may 
have  produced  a schema  or  expectation  condition  within  the  pilots  that  allowed  for  discrimination  of  the 
incoming  data,  thus  reducing  the  information  processing  load  for  any  given  task  (Crosby,  1977).  Although 
the  effects  of  this  training  were  not  evident  on  the  second  aircraft  sortie  with  current  measures,  this  schema 
may  actually  contribute  to  a “wholistic”  understanding  (Klein,  1977),  allowing  more  attention  to  the  total 
requirements  of  air  refueling. 

Thus,  training  programs  and  media,  such  as  this  device,  may  have  value  not  merely  in  terms  of 
training  procedural  tasks,  but  in  having  a general  effect  on  the  overall  proficiency  for  the  more  complex 
fiying  skills. 
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APPENDIX  A:  AIR  REFUELING,  Excerpt  from  F-4  Phase  Manual  F4000B/C/X/I 


Local  Special  Instructions 

I Aircrew  members  will  be  familiar  with  TO  1-1C-1-8  and  TACR  554  (Chaps  3 and  8). 

2.  Minimum  in-flight  visibility  for  tanker  rendezvous  with  student  crews  is  two  miles  (Phase  manual). 

using  ,he  al,ernate  anchor  refueling  procedures  (i.e.,  no  CRC  or  GCI  radar  ava  table  to 

;’fTra,10?.S  ' addl,,onal  receiver  nieh,s  wUI  nof  ^Part  the  ARIP  untU  the  previous  receiver 
ght  has  departed  the  anchor  pattern  and  the  tanker  is  back  in  orbit  at  the  anchor  point  (TO  1-1C-1-8). 

trail  (TO  MC-riT)n,aCt  CheCkl'S‘  wUI  be  comPle,ed  in  l,le  observation  position  or  prior  to  reaching  1 NM  in 

5.  Pressure  refueling  is  prohibited  unless  required  to  safely  recover  the  aircraft  (Chap  8). 
training  ^ GA‘  GAT’  °f  °AN  Local  Special  lnstructions  for  applicable  information  on  post-refueling 

ii,a  l'  .Ain ,refueli"g  wil1  not  be  attempted  by  students  if  the  tanker  director  lights  are  inoperative.  Tanker 
director  lights  are  the  primary  reference  during  refueling  operations. 

will  permit. 'b'  Pil°'S  ^ ^ WUh  the  Sa"1C  'P  °"  AR  12  insofar  “scheduling  flexibility 
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APPENDIX  H:  CRITERION  REFERENCED  OBJECTIVES 


1.  From  memory,  list  the  azimuth,  elevation,  and  extension  limits  of  the  KC-135  air  refueling 
boom/probe  IAW  the  Air  Refueling  Phase  Manual. 

2.  Using  a diagram  of  the  KC-135  air  refueling  director  lights,  describe  each  lights  operation  and 
function  during  air  refueling  IAW  the  Aii  Refueling  Phase  Manual. 

3.  From  memory,  list  six  methods  of  disconnect  from  the  KC-135  air  refueling  boom  IAW  the  Air 
Refueling  Phase  Manual. 

4.  Using  the  Air  Refueling  Director  Lights  Trainer  in  the  automatic  mode,  remain  within  the  boom 
envelope  (less  than  three  seconds  with  any  red  outer  limit  light  displayed)  for  a period  of  live  minutes. 


APPENDIX  C AIR  REFUKLING,  Excerpt  from  TAC  Syllabus  Course  No.  F4000B 


Special  Instructions 

1.  Air  Refueling  14  will  be  llown  in  conjunction  with  any  mission  alter  the  Bl  M phase. 

a.  The  more  restrictive  crew  line-up  shown  for  each  mission  will  apply. 

b.  AR  1-3  must  be  accomplished  prior  to  flying  AR  5-6. 

c.  The  air  refueling  training  continuity  must  be  closely  monitored  by  supervisors. 

d.  A separate  air  refueling  and  the  respective  mission  grade  slip  will  be  accomplished. 

2.  TR-1 3 must  be  flown  prior  to  GAN-I  and  AR-5. 

3.  GAN  special  instructions  apply  to  AR  5/6. 


4 r5fueling  wi"  not  bc  conducted  with  both  the  receiver  pilot  and  boom 
status.  The  flight  leader  will  coordinate  with  the  tanker  crew  to  assure  compliance 
assuming  the  pre-contact  position. 


operator  in  student 
prior  to  a.rv  aircraft 


5.  Including  GAN  I,  a 
GAN  sortie  must  be  flown  if 


minimum  of  two  night  weapons  delivery  sorties  are  required.  One  additional 
circumstances  prevent  weapons  delivery  on  both  AR  5 and  6. 


AR-I 

.2 


AR-3 

4 


AR-5 


AR-6 


Aircraft:  4 

Crew:  IP/WSO;  P/IP;  P/[P;  p/|p 

Tanker  rendezvous,  hook-up,  refuel,  disconnect,  observation 
position  and  reform.  Proceed  with  applicable  mission. 

Aircraft : 4 

Crew:  IP/WSO;  P/WSO;  P/IP;  P/WSO 

Tanker  rendezvous,  hook-up,  refuel,  disconnect,  observation 
position  and  reform.  Proceed  with  applicable  mission. 

Aircraft:  4 

Crew:  IP/X,  P/IP;  P/IP,  p/jp 


Tanker  rendezvous,  hook-up,  refuel,  disconnect,  observation 
position,  and  reform.  Separate  into  two  elements  and  proceed  to 
separate  range/range  periods.  30-degree  and  low  angle/low  drag 
bomb  with  flares,  30-degree  and  low  angle/low  drag  bomb  with 
ground  marking  devices,  flare  delivery,  instrument  recovery. 

Aircraft:  4 

Crew:  IP/X;  P/WSO;  P/IP;  P/WSO 


Tanker  rendezvous,  hook-up,  refuel,  disci  meet,  observation 
position,  and  reform.  Separate  into  two  elements  and  proceed  to 
separate  range/range  periods.  30-degree  and  low  angle/low  drag 
bomb  with  flares,  30-dcgree  and  low  angle/low  drag  bomb  with 
ground  marking  devices,  flare  delivery,  instrument  recovery. 


Time:  1.0 


Time:  1 .0 


Time:  2.4(Night) 

Config:  D-I1/1IA 
DIO 


Time:  2.4<Night) 

Config:  D-II/IIA 
D-IO 


APPENDIX  D AIR  REFUELING,  Excerpt  from  TAC  Briefing  Guide  Course  No.  F4000B 
Special  Instructions 

1.  Tluee  rules  basic  to  all  emergency/abnormal  conditions  should  be  thoroughly  understood  and 
applied  by  the  pilot  . 

a.  Maintain  aircraft  control 

b.  Analyze  the  situation  and  take  the  proper  action 

c.  Land  as  the  emergency  dictates 

2.  Aircrews  must  be  fully  aware  of  the  requirements  for  sufficient  crew  rest  as  defined  in  AFR  bO-l, 
and  the  consequences  when  crew  rest  requirements  are  violated. 

3.  In  accordance  with  SACR  55-S2/TACR  55-7,  air  refueling  will  not  be  conducted  with  both  the 
receiver  pilot  and  boom  operator  in  student  status.  The  flight  leader  will  coordinate  with  the  tanker  crew  to 
assure  compliance  prior  to  any  aircraft  assuming  the  precontact  position. 

4.  Each  sortie  requires  a minimum  of  one  wet  hook-up  and  as  many  dry  hook-ups  as  tanker  time 
allows. 

Specific  Mission  Briefing  Guide  (AR) 

1 . SPECIAL  INSTRUCTIONS/RESTRICTIONS  (Briefing  Guide  and  Syllabus) 

2.  AIR  REFUELING  DATA  (CARD) 

3.  REFUELING  TRACK 

a.  AR1P 

b.  ARCP 

c.  Altitude 

d.  Airspeed 

e.  Call  sign  (tanker/GCI) 

4.  RENDEZVOUS  PROCEDURES 

a.  VFR/IIR 

b.  Radar  join-up 

c.  Navigation/ receptacle  lights 

d.  Radio  calls 

e.  Formation 

f.  Hot  armament  checks 


g.  Join-up,  observation  position 


h.  Refueling  checklist 

i.  Rendezvous  overrun 

5.  REFUELING 

a.  Precontact 

b.  Radio  calls 

c.  Aircraft  lighting  (receiver/tanker) 

d.  Techniques  (afterburner) 
c.  Boom  limits 

( 1)  25  degrees  - 40  degrees  down 

(2)  10  degrees  left  or  right 

(3)  6-18' extension 

f.  Planned  offload  (log  in  AFTO  781) 

g.  Disconnect  (primary/secondary) 

h.  Wake  turbulence  considerations. 

6.  EMERGENCY  PROCEDURES 

a.  Refuel  valve  malfunctions 

b.  Damaged  receptacle 

c.  Reverse  transfer 

d.  Breakaway 

e.  Tension  disconnect 

f.  Radio  silence  procedures  (visual  signals) 

g.  Abort  point/base 

7.  OFF-TANKER  REJOIN 

Refer  to  Special  Instructions  and  Specific  Mission  Briefing  Guides  for  post -tanker  training 
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